Skip to content

Retry download mid stream & pin python 3.11 - #160

Merged
Kostis-S-Z merged 5 commits into
mainfrom
retry-mid-stream
Nov 3, 2026
Merged

Kostis-S-Z merged 5 commits into
mainfrom
retry-mid-stream

Conversation

@Kostis-S-Z

@Kostis-S-Z Kostis-S-Z commented Nov 2, 2026 •

Copy link
Copy Markdown
Contributor

In-process retry. A connection that drops while the archive is streaming is retried against the same URL, continuing from the bytes already on disk. Only connection-level failures (ConnectionError, Timeout, ChunkedEncodingError) are retried; HTTP errors and KeyboardInterrupt still fail at once. Default is 3 attempts, configurable with the new max_download_attempts argument on download_dataset, download_sample and load_dataset.

@Kostis-S-Z Kostis-S-Z changed the title Retry download mid stream Retry download mid stream & pin python 3.11 Nov 3, 2026
@Kostis-S-Z
Kostis-S-Z marked this pull request as ready for review November 3, 2026 10:36
@Kostis-S-Z
Kostis-S-Z merged commit 5dc0036 into main Nov 3, 2026
3 checks passed
@Kostis-S-Z
Kostis-S-Z deleted the retry-mid-stream branch November 3, 2026 10:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant